What is the principle of HDFS?

This article introduces the relevant knowledge of "what is the principle of HDFS". In the operation of actual cases, many people will encounter such a dilemma. Then let the editor lead you to learn how to deal with these situations. I hope you can read it carefully and be able to achieve something! I. the main features of HDFS

2022-06-01 Servers 我要分享

Introduction of Flink State Management and Fault tolerance Mechanism

Author: Shi Xiaogang this article is from the Flink Meetup conference held in Beijing on August 11, 2018. It is shared by Shi Xiaogang, who is currently engaged in the research and development of Blink in the Ali big data team site, and is now mainly responsible for the research of Blink state management and fault tolerance related technologies.

2022-06-03 Internet Technology 我要分享

On distributed CAP Theorem

With the development of the Internet, due to the problems of large amount of data and high concurrency of operation, most website projects adopt distributed architecture. The biggest characteristic of the distributed system is that the data is scattered, and the data will be inconsistent in different network nodes at some time (data is not synchronized, data is lost). In 2000, Er

2022-06-03 Internet Technology 我要分享

What is the fault-tolerant isolation method of micro-service architecture

This article mainly explains "what is the fault-tolerant isolation method of micro-service architecture". The content of the explanation is simple and clear, and it is easy to learn and understand. let's study and learn "what is the fault-tolerant isolation method of micro-service architecture"! 1. In the micro-service architecture

2022-06-01 Internet Technology 我要分享

How to apply Hadoop MapReduce

This article will explain in detail how to use Hadoop MapReduce. The editor thinks it is very practical, so I share it with you as a reference. I hope you can get something after reading this article. Cascading: a simple Hadoop Map

2022-06-02 Development 我要分享

Wide dependence and narrow dependence of spark

1 RDD dependencies and fault tolerant 1.1 RDD dependencies RDD can be divided into two types: narrow dependency (Narrow Dependencies) and wide dependency (Wide Dependencies), which is called Shuffle De in source code

2022-06-03 Internet Technology 我要分享

Talking about HDFS Architecture

1. HDFSHDFS (Hadoop Distributed File System) is the core sub-project of the Hadoop project, the foundation of data storage management in distributed computing, and is developed based on the requirements of streaming data pattern access and processing of very large files.

2022-06-03 Internet Technology 我要分享

Introduction to hbase

Summary: HBase is a distributed column storage system built on HDFS; HBase is a typical key/value system based on GoogleBigTable model; HBase is an important member of ApacheHadoop ecosystem

2022-06-02 Servers 我要分享

VMware Virtual SAN storage design planning

Click here to view the original directory 1, capacity planning 11) original capacity 12) number of failures allowed 13) calculation required capacity 24) capacity sizing guidelines 35) considerations for virtual machine objects 4 II, SSD cache design plan 51) in PCI

2022-06-02 Servers 我要分享

What is the common application scenario of Paxos algorithm in large-scale systems

This article shows you what is the common application scenario of Paxos algorithm in large-scale systems, the content is concise and easy to understand, it can definitely brighten your eyes. I hope you can get something through the detailed introduction of this article. In the field of distributed algorithms, there is a very important algorithm called Paxo

2022-05-31 Servers 我要分享

How does hbase store the underlying data

Editor to share with you how hbase stores the underlying data, I believe most people do not know much about it, so share this article for your reference, I hope you can learn a lot after reading this article, let's go to know it! Hbase depends on "HDFS" for storage

2022-06-02 Internet Technology 我要分享

How to understand the core RDD of Spark

This article introduces you how to understand the core RDD of Spark, the content is very detailed, interested friends can refer to, hope to be helpful to you. Unlike many proprietary big data processing platforms, Spark is based on a unified and abstract RDD, which enables it to base on

2022-06-01 Internet Technology 我要分享

Distributed cache

This paper will introduce distributed caching from a theoretical point of view. When building large-scale web applications, caching technology can be said to be necessary, and the necessity of learning is self-evident. Distributed cache Overview 1.1 characteristics of distributed cache distributed cache has the following characteristics: 1) High performance: when traditional database side

2022-06-01 Database 我要分享

How does HDFS work?

This article will explain in detail how HDFS works. The editor thinks it is very practical, so I share it with you for reference. I hope you can get something after reading this article. How HDFS works HDFS supports the rapid transfer of data between computing nodes. At the beginning stage

2022-06-01 Internet Technology 我要分享

What is the function of Hadoop MapReduce?

This article mainly introduces "what is the function of Hadoop MapReduce". In daily operation, I believe many people have doubts about the function of Hadoop MapReduce. The editor consulted all kinds of materials and sorted out simple and easy-to-use methods of operation.

2022-05-31 Servers 我要分享

What is the principle of CAP in micro-service architecture?

What this article shares with you is about what the CAP principle in the micro-service architecture is. The editor thinks it is very practical, so I share it with you to learn. I hope you can get something after reading this article. What is the principle of distributed CAP and what is

2022-06-01 Internet Technology 我要分享

Overview of ecosystem

An overview of the Hadoop ecosystem and its version derivation the main content of this article is to grasp the various components of the Hadoop system as a whole, and the functions of each component, and elaborate macroscopically, so as to lay a foundation for further study of hadoop. One thing about the Hadoop ecosystem: 1. Open source and free

2022-06-03 Internet Technology 我要分享

Brief introduction of distributed system and NoSQLl

Introduction to distributed system and NoSQL = data storage 1. Data storage

2022-06-01 Database 我要分享

[NoSQL] 01, NoSQL Foundation

ACID, distributed, CAP, BASE theoretical relational databases follow ACID rules transaction in English is transaction, which is very similar to transactions in the real world, it has the following four characteristics: 1. A (Atomicity) atomicity is very atomic.

2022-06-01 Database 我要分享

Which projector TV is practical? The 100-inch screen projector is the C player.

Now everything seems to be in pursuit of "big", egg tarts have a larger version, milk tea has XL cups, mobile phones also have 512GB of memory. In a variety of large products, display devices are also developing towards a large screen. People will choose IMAX when watching movies and big TV when watching videos, so they will have a meeting at the company.

2023-11-24 IT Information 我要分享